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DYNAMIC BACKUP ROUTING OF NETWORK TUNNEL PATHS FOR LOCAL 
RESTORATION IN A PACKET NETWORK 



5 BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to routing packets in a telecommunications network, and, 
more particularly, to determining paths through nodes of the network for dynamic backup routing 
of packets for restoration. 

10 Cross-Reference to Related Applications 

This application claims the benefit of the filing date of U.S. provisional application nos. 
60/216,394, filed on July 6, 2000, and 60/239,771, filed on October 12, 2000. 

^3 Description of the Related Art 

y f In interconnected packet networks, such as the Internet, users establish a connection 

IH5 between a source and a destination with a stream of data packets (called a "packet flow" or 

m "flow") transferred through the network over a network path. The network path is defined by a 

L set of nodes interconnected by a set of links through which packets of the connection are 

:= J transferred. Packet networks may have a hierarchical structure in which smaller networks are 

ill interconnected by larger networks, and a peer structure in which equivalent networks are 

^0 interconnected. A packet network connects to one or more other packet networks through 
ingress and egress points (routers) of the network. 

Interior routing protocols are employed by network routers to determine a path through 
the nodes of the network along which packets between a source (ingress) and destination (egress) 
pair are forwarded. Packets received by a node's router are forwarded to other nodes based on a 

25 forwarding table constructed in accordance with the interior routing protocol, but may also be 
through routes installed with explicit route provisioning. Interior routing protocols may also 
specify network topology, link capacity/usage, and link-state information ("network 
information") that is exchanged between the network nodes. Network information allows the 
node's router to construct the corresponding forwarding table. An example of a widely used 

30 interior routing protocol for "best-effort" routing is the Open Shortest Path First (OSPF) 
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protocol. In addition, some routing protocols associate a link "cost" with each link between 
nodes. This link cost may be associated with, for example, average link utilization or revenue 
generated by the link, as well as link "importance" in the network (i.e., how critical the link is to 
packet routing). When link-state information or link-bandwidth information (e.g., connectivity 
5 or available bandwidth) is exchanged between routers, each router in the network has a complete 
description of the network's topology. 

Routing protocols, in addition to providing connectivity, may also enable traffic 
management. The Multi-Protocol Label Switched (MPLS) standard, for example, allows such 
routing protocols for traffic management. The MPLS standard may be employed for networks 
10 having virtual circuits (packet flows) or label switched paths (LSPs) with provisioned service 
levels (also known as guaranteed quality-of-service (QoS) levels). 

O Provisioned service levels may be, for example, a guaranteed minimum bandwidth for the 

£0 path of a packet flow through the network. This path having a guaranteed level of service 
: % between ingress and egress points may be referred to as a Network Tunnel Path (NTP). As 
yj) would be apparent to one skilled in the art, specific implementations of NTPs exist for different 
m types of networks. As examples of NTPs, virtual circuits may be established for packet flows in 
jU TCP/IP networks, virtual circuits may be established for cells in Asynchronous Transfer Mode 
y (ATM) networks, and label switched paths (LSPs) may be established for packets in MPLS 
IJi networks. Packets of a signaling protocol, such as RSVP (Reservation Protocol for IP and MPLS 
120 networks) with traffic engineering extensions or CR-LDP (Constrained Routing Label 

Distribution Protocol for MPLS networks), may be used to reserve link bandwidth and establish 
an NTP, NTPs may be provisioned as explicit routes along specific paths between nodes of the 
network (i.e., when an NTP is provisioned, all intermediate points may be specified through 
which a packet passes between the ingress and egress points of the NTP). 

25 In MPLS networks, packets are encapsulated by appending to the packet, or forming from 

the packet, additional information when the packet is received at an ingress point. The additional 
information, sometimes referred to as a label, is then employed by routers of the network to 
forward the corresponding packet. In some cases, the label may simply be a pointer that 
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identifies or is otherwise related to specific origination and termination address fields in the 
header of the received packet. 

Of increasing importance to network designers is to design networks with NTPs having 
guaranteed levels of service that incorporate restoration mechanisms, such as MPLS restoration 
5 for LSPs. These restoration mechanisms allow for provisioning of, and/or capacity reservation 
for, backup paths through the network onto which traffic of affected NTPs may be redirected 
relatively quickly upon detection of an element/link failure within the network. Often, the 
restoration path is provisioned concurrently when the original NTP of a request arriving at the 
network is provisioned. 

10 Prior art methods to provide backup for network element/link failures usually determine 

two link-disjoint paths between the source and the destination of the demands, and then use one 
Q for the primary and one for the secondary. This prior art method is sometimes referred to as end- 
m to-end restoratioa In end-to-end restoration, the secondary (backup) path is link (and/or node) 
'% disjoint from the primary (active) path. Link disjoint means that the primary and secondary paths 
'4 5 do not have any links in common. Node disjoint means that the primary and secondary paths do 
B not have any nodes in common, with the exception of the source and destination nodes. 

D FIG. 1 shows a network 100 having primary path 101 and secondary path 102 for a 

p connection having end-to-end restoration between source node s (node 111) and destination node 
5^ t (node 115). Primary path 101 (shown with solid link arrows) passes from node 1 1 1 through 
SO nodes 1 12, 1 13, and 1 14 to the destination node 115. Secondary path 102 (shown with dashed 

link arrows) passes from node 1 1 1 through nodes 116, 117, and 1 18 to the destination node 115. 

FIG. 2 shows the network 100 of FIG. 1 in which a failure between nodes 1 13 and 114 occurs. 

FIG. 2 shows the direction of information transfer from node 113 through node 1 12 to the source 

s (node 1 1 1) to detect the failure for the paths illustrated in FIG. 1 . The information transferred 
25 is simply that the link has failed. The information is transferred back to the source, which then 

switches to the backup secondary path 102. 

However, this approach in end-to-end restoration may have an unnecessarily long delay 
before switching from the primary to secondary path. This delay may occur because information 
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has to propagate back to the source, which in turn switches from the primary to the secondary 
path for all the demands that use the link. 

SUMMARY OF THE INVENTION 

In accordance with embodiments of the present invention, a packet network of 
5 interconnected nodes employs dynamic backup routing of a Network Tunnel Path (NTP) request. 
Dynamic backup routing allocates an active and backup path to the NTP. Dynamic backup 
routing employs a local restoration model to determine the allocation of, and, in operation, to 
switch between, a primary (also termed active) path and a secondary (also termed backup) path 
based upon detection of a network failure. Switching from the active path is based on a backup 
10 path determined with iterative shortest-path computations with link weights assigned based on 

the cost of using a link to backup a given link in the active path. Costs may be assigned based on 
G single-link failure or single element (node or link) failure. Link weights are derived by assigning 
CQ usage costs to links for inclusion in a backup path, and minimizing the costs with respect to a 
predefined criterion. For single-link failure, each link in the active path has a corresponding 
JIB disjoint link in the backup path. For single-element failure, in addition to backup of the final link 
w in the active path, all links incident have disjoint bypass links assigned to account for node 
n failure. While intra-demand sharing is used, inter-demand sharing may also be provided if 
«2 complete network information is available for dynamic backup routing. 

In accordance with an exemplary embodiment of the present invention, data may be 
teO routed through a network having a plurality of nodes interconnected by a plurality of links 

represented by a graph. A path request is received for routing the data between a source node 
and a destination node in the network based on a demand. The links in the graph are reversed to 
generate paths from the destination node to nodes along reverse paths to the source node. 
Shortest-path computations are performed for portions of the reverse paths to generate weights 
25 for potential active-path links, wherein each weight of a link in a reverse path is based on a 
number of reverse paths in which the link is included. The shortest-path computations are 
repeated for the graph from the destination to the source using the weighted links to generate an 
active path satisfying the path request, wherein each link in the active path has a defined back-up 
path. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Other aspects, features, and advantages of the present invention will become more fully 
apparent from the following detailed description, the appended claims, and the accompanying 
drawings in which: 

FIG. 1 shows a network having primary and secondary paths for a connection having end- 
to-end restoration of the prior art between source and destination nodes; 

FIG. 2 shows a failure and direction of information transfer upon a failure for the paths of 
the network illustrated in FIG. 1 ; 

FIG. 3 shows a network having a set of nodes interconnected by a set of links and 
employing dynamic backup routing in accordance with embodiments of the present invention; 

FIG. 4 illustrates detection of link failure for a node immediately upstream from a 
destination node initiating transfer of traffic to a corresponding backup link; 

FIG. 5 shows an exemplary algorithm for dynamic backup routing in accordance with the 
first exemplary embodiment of the present invention; and 

FIG. 6 shows a network illustrating the shortest-path computations backward from the 
destination for one step in the exemplary algorithm of FIG. 5. 



DETAILED DESCRIPTION 

In accordance with embodiments of the present invention, dynamic backup routing of a 
Network Tunnel Path (NTP) allocates an active and backup path to the NTP based upon 
detection of a network failure. Dynamic backup routing employs local restoration to determine 
the allocation, and, in operation, to switch between a primary (also termed active) path and a 
secondary (also termed backup) path. In local restoration, nodes on either end of one or more 
failed links switch traffic to a backup path. Switching from the active path is based on a backup 
path determined with iterative shortest-path computations with link weighting based on the cost 
of using a link to backup a given link for either single-link failure or single element (node or 
link) failure. Active and Back-up paths generated in accordance with embodiments of the 
present invention may provide for local restoration with relatively short delay in switching to a 
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backup path. 

In local restoration, when an element (a node or link) supporting a network tunnel path 
(NTP) fails, the nodes coupled to the element detect the failure and immediately switch all the 
connections (previously routed NTP demands) passing through the failed node or link to 
5 corresponding alternate paths. An NTP may fail if either a link in the path fails or a node in the 
path fails. If a link fails, then each provisioned connection passing through the link is routed to 
its backup link. However, if a node fails, dynamic backup routing of each provisioned 
connection passing through the node accounts for loss of all outgoing links from the element 
when routing an NTP to a restoration path. 

10 As defined herein, a "demand" refers to an amount of service level capacity, such as 

bandwidth, necessary for a provisioned NTP request. Also, the terms "predecessor" and 

O "upstream" node or link refer to nodes or links that are toward the NTP source in a path, while 

fg the terms "successor" and "downstream" node or link refers to nodes or links that are toward the 
NTP destination in a path. Dynamic backup routing in accordance with embodiments of the 

|J5 present invention may account for single-link failure only, or may account for single-element 

CO failure in which either a single node or a single link fails. 

□ Thus, in accordance with embodiments of the present invention, the active path is 

□ determined based upon a criterion that the amount of bandwidth consumed by the active and 
'ti backup path is at a relative minimum. The graph is modified such that shortest-path 

WO computations yield active and backup paths satisfying the criterion. The backup path, once the 
active path is provisioned, is thus disjoint from the path including the point of failure, either i) 
link or ii) node or link failure, based upon local restoration routing. A backup path is not 
provided if the source or the destination of the traffic fails. 

FIG. 3 shows a packet network portion 300 having a set Vof nodes 301 through 313 
25 interconnected by a set E of links 301 < ij < 3 1 2 and tej. Network 300 may optionally 

include route server 350 that receives an NTP request, and provisions active and backup paths in 
accordance with an exemplary embodiment of the present invention. Alternatively, dynamic 
backup routing may be implemented in a distributed fashion by a processor of one or more of 
nodes 301 through 312. Nodes 301 through 312 employ dynamic backup routing in accordance 
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with one or more exemplary embodiments of the present invention. Node 301 is the source node 
s and node 3 12 is the destination node t for an NTP request having demand d. 

When dynamic backup routing is employed to backup for single-link failure, each link in 
the active path has its own corresponding backup link(s) as part of a backup path. For the single- 
5 link failure case, the backup path for a link /(/, J) may be any path around nodes i and; that does 
not include link /(y). The nodes that are at the end points of the failed link detect that the link 
has failed and they immediately switch all the demands that go on this link to the alternate path. 
Note that while the figures show links having one direction, not shown in the links are 
corresponding links in the opposite direction and links that may separately connect the nodes. 
10 Information regarding failures (link or node) flow upstream through one or more of these paths. 

This backup path for link may employ any link within the network including: i) any links on 
f =j the active path for the current demand (apart from link /(/, j)) and ii) any links that are used in the 
H backup path for other active links. FIG. 3 shows a single-link failure of link 7(303, 304), and the 
*0 information transfer, since local restoration is employed, travels to only node 303, which initiates 
Jft a transfer to a backup path over links /(303, 308) and /(308, 304) through node 308. For the 
y network of FIG. 3 that shows a single-link failure (i.e., failure of link 7(303,304), for example, the 
^ active and backup paths may be defined as given in Table 1 : 



Table 1 



Primary Path Links 


Backup Path 


source (301) to 302 


301 to 305 to 306 to 302 


302 to 303 


302 to 307 to 308 to 304 


303 to 304 


303 to 308 to 304 


304 to destination (312) 


304 to 309 to 310 to 311 to 312 



20 For a single-element failure, either a link or a node may fail. For a node failure, all the 

links on this node fail and dynamic backup routing desirably designs the backup path to protect 
against the node's link failures by determining a backup path for every incident link of the node 
and the last link in the active path to the destination node. Single-element failures may be 
detected by nodes that are at endpoints of links outgoing from the failed node. 
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For single-element failures, the backup path for the failure of node k includes several 
steps. First, determine the incoming and outgoing links l(j,k) and l(km) in the active path 
passing through node k If node k fails, all links incident on node k fail, and in particular, link 
l(j,k). Therefore the failure will be detected at node j and if there is an alternate path from node;' 
to node m (or some other node between m and the destination t) then node j can divert traffic 
along this backup path. The backup path for the failure of node k avoids all links incident on 
node k. Generating bypass links for the single-node failure also provides backup paths for link 
failures, with the exception of the last link on the active path that reaches the destination. The 
exception is shown for the path illustrated in FIG. 4. Therefore, in contrast to the embodiments 
for dynamic backup routing accounting for single-link failure only, dynamic backup routing 
accounting for the single-element failure provides a backup path for all possible single-node 
failures and the failure of the last link in the active path reaching the destination node. For the 
network of FIG. 4 that shows a single-element failure (i.e., node 404), for example, the active and 
backup paths may be defined as given in Table 2: 



Table 2 



Primary Path 


Backup Path 


Node 402 


401 to 405 to 406 to 403 


Node 403 


402 to 406 to 407 to 408 to 404 


Node 404 


403 to 407 to 408 to 409 to 412 


Link /(404, 412) 


404 to 409 to 410 to 41 1 to 412 



While capacity on the active path is not necessarily shared, capacity of the backup path 
may be shared in two ways: inter-demand sharing and intra-demand sharing. Inter-demand 
sharing refers to sharing of the backup bandwidths belonging to different demands. For example, 
if two equal demands between a given source and destination do not share any links in common 
on the active path, then the backup path for these two demands may be shared entirely. Intra- 
demand sharing refers to sharing of capacity between backup links on the backup path for a 
demand when the links in the active path have backup links/paths with some links in common. 



1DS#122779{990 0341) 



8 



Case Name Kodmlam 15-17 



However, even if the two demands on the primary path share some links in common, it may still 
be possible for dynamic backup routing to share capacity between backup path links on the 
backup path with inter-demand sharing. 

Referring to FIG. 3, link /(8, 4) is common to the backup paths that backup links 1(2, 3) 
5 and /(3, 4). Thus, backup capacity of link /(8, 4) is shared on this link for backup links belonging 
to the same demand and is an example of intra-demand sharing. When computing backup paths, 
the amount of sharing employed by a given implementation depends on the amount of network 
information (e.g., link-usage information) that is available to the dynamic backup routing 
algorithm. 

10 Dynamic backup routing in accordance with embodiments of the present invention may 

have either complete, partial, or minimal network information available. Complete network 
O information includes information of all provisioned NTP demands through the network, 
B information about the network topology, residual capacities of the links of the network, and 
"1! routes for currently provisioned active and backup paths for connections currently traversing the 
% network. In general, if a centralized network route server (such as route server 350 of FIG. 3) is 
CO employed, this complete information may be available. However, routing of NTP requests may 
f-; ; be done in a decentralized manner, as may be the case when several different providers are 
2; interconnected within the packet network. Such networks may still employ a form of link-state 
Ul flooding mechanism. Such link-state flooding mechanism allows all nodes in the network to 
Jjt) have partial network information available to its routing algorithm. Partial information includes 
the total amount of bandwidth on a link used by primary paths, the total amount of bandwidth 
that is used by secondary paths, and the residual capacity of each link. When minimal network 
information is available, the dynamic backup routing algorithm has only information regarding 
the residual capacities of the network links. 

25 Thus, a given implementation of dynamic backup routing of NTPs for restoration may 

account for 1) restoration in response to a single-link failure for complete, partial, or minimal 
network information; and 2) restoration in response to a single element (node or link) failure for 
complete, partial, or minimal network information. For ease in understanding the present 
invention, the following describes an exemplary dynamic backup routing algorithm for the 
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single-link failure case, first for complete information and then with modifications to account for 
partial information. With the algorithm of dynamic backup routing described for the single-link 
failure, then the modifications to account for single-element failure are described. 

A network (such as network 300 of FIG. 3) may be described by a directed graph GR 
5 (V,E) that represents the packet network. Graph GR (V,E) comprises the set Fof nodes with a 
corresponding set E of links that interconnect the nodes. The node 5 6 V represents the source 
node and / 6 V represents the destination node (where " e" is the mathematical term for "element 
of). Each link /(/, j) 6 E denotes a link that is a directed edge (arc) in the graph, and d represent 
the current demand size that is to be routed over a path through the available backup bandwidth 
10 (the "backup path"). Dynamic backup routing generates an active path in graph GR (V,E) for an 
NTP request defined by the triple (s, t, d\ and generates the backup links of the backup path 

□ during the process of generating the active path. In the triple (s, /, d) 9 d is the demand of b units 
« I of, for example, minimum bandwidth that must be supported in the backup path. As known in 

the art, service level (e.g., QoS) guarantees may, in general, be converted to an effective 
U15 bandwidth. 

Gl NTP requests arrive one-by-one. NTP requests are desirably routed by an on-line 

□ implementation of the dynamic backup routing algorithm that routes both the active path and the 
? J backup path for each link or node while meeting the service provider traffic engineering 

y requirements. Each NTP request to set-up a connection with a given demand arrives one at a 
30 time. Each request has an ingress node, an egress node and an associated bandwidth. For 

wavelength switched paths, the bandwidth is just the wavelength capacity or unit bandwidth if all 
wavelengths have identical capacity. If sufficient bandwidth is not available to set up either the 
active path or the backup path then the connection set-up request is rejected. 

Dynamic backup routing employs repeated invocations of a shortest path routing 
25 algorithm, such as Dijkstra's algorithm, to generate links for the backup path. To generate a 
forwarding table, each router of a node computes a set of preferred paths through the network 
nodes, and may use link weighting to calculate the set of preferred paths. Link weighting is 
implemented by assigning usage costs to back-up links based on a predefined cost criterion. 
Each preferred path has a minimum total weight between nodes as well as a minimum summed 
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weight through nodes of the path, which is known in the art as shortest-path routing. This set of 
preferred paths may be defined with a shortest-path tree (SPT) in a directed graph. The SPT may 
be calculated using an algorithm such as Dijkstra's algorithm, described in E. Dijkstra, "A Note: 
Two Problems In Connection With Graphs " Numerical Mathematics, vol.1, 1959, pp. 269-271. 

FIG. 5 shows an exemplary algorithm for dynamic backup routing in accordance with an 
embodiment of the present invention. At step 501, the algorithm generates the graph GR (V,E) of 
the network, possibly accounting for the demand of the NTP request defined by the triple (s, t 9 d). 
Accounting for the demand of the NTP request may be to delete those links in the graph having 
insufficient capacity to route the demand in an active and/or backup path. Step 501 may simply 
update the graph, if necessary, if the graph was generated previously. 

At step 502, the algorithm initializes variables and the graph by reversing the direction of 
all arcs in the network. After initialization, the graph may only include those links and nodes that 
are present in the network that can support the demand in either an active or backup path. As 
used herein, "arc" or "edge" refers, mathematically, to the link of a directed graph. The 
initialization of the graph in step 502 employs complete, partial, or minimal information that is 
available, and reverses the direction of the links for shortest-path computation from the 
destination, as described subsequently. 

After step 502, an iterative process begins to step through the links of the graph GR (V,E) 
to choose links for the active path and to weight the links, with each link weight based on a cost 
of providing the link in a backup path. The computed usage cost of a link depends on whether 
complete, partial, or minimal information is available to allow inter-demand and possibly intra- 
demand sharing of backup links, as described subsequently, between the backup path of the 
current NTP request (5, t, d) and backup paths of other NTP requests. 

At step 503, the cost of providing a given link with a local backup is computed for the 
link by summing the usage cost of links for each partial backup path that routes the demand. 
Each usage cost is generated as the cost of using one or more given links disjoint from the active 
path link to backup the link in the active path. The usage costs are computed with multiple 
invocations of a shortest-path computation for each partial backup path including the link 
because the backup path for a link can terminate at any point (node) on the path from that link to 
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the destination. For example, the termination point on the path may be the upstream node from a 
detected single-link failure. Since the amount of intra-demand saving is a function of the node 
where the backup path ends, the shortest path algorithm is executed from each node in the path 
from the current link to the destination. At step 504, using the usage costs of the link, the link is 
weighted. Generating usage costs may also generate reserved link bandwidth along the backup 
path. 

At step 505, the shortest path through the network is generated using the link weights, 
which provides the current links in the active path as well as specified reserved bandwidth on 
links in GR(V,E) for the backup path. 

At step 506, a test determines if the cost of the last link has been calculated, which is 
equivalent to reaching the source node from the destination node. If the test of step 506 
determines that the current link is not the last link, the process returns to step 503 to calculate a 
weight for the next link. If the test of step 506 determines that all links weights have been 
calculated, the process moves to step 507. At step 507, the active path is provided to route the 
demand of the NTP request, and the backup links corresponding to the links of the active path are 
provided as the backup path. With such backup links provided, provisioning may subsequently 
reserve bandwidth in the backup path for the NTP request connection. 

The relationship between costs assigned to links of step 503 and whether complete, 
partial, or minimal information is available, is now described. 

When complete information is available, dynamic backup routing may permit best sharing 
of backup capacity, but may be computationally impractical or unrealistic in terms of stored 
network information. Dynamic backup routing using partial information allows for both intra- 
demand and inter-demand sharing of backup capacity, while using a relatively small amount of 
stored information regarding network provisioning. For dynamic backup routing with minimal 
network information, inter-demand sharing may not necessarily be accounted for since relevant 
information of backup bandwidth usage is not available, but may still provide reasonable 
performance of routing backup paths. 

To determine the amount of sharing the following definitions are used herein. The set A v 
represents the set of demands that use link /(/, j) for each demand's active path and the set B v 
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represents the set of demands that use link /(/, j) for each demand's backup path. The tf h element 
b k of either the set A & or set B y is a bandwidth reservation of the # h existing provisioned NTP 
connection. The variable F tJ represents the total amount of bandwidth reserved for the demands 
in the set A v that use the link /(/, j) on the active path, and the relation for the variable F y is given 
in equation (1): 

The variable G tJ represents the total amount of bandwidth reserved for backup path 
demands (in the set B tJ ) whose backup paths use link /(/, j). The relation for the variable G v is 
given in equation (2): 

G v = 2> (2) 

The variable R v represents the residual bandwidth of link /(/j) and is equivalent to (C v - 
Fy - G lJ ), where C v is the total capacity of the links. R v represents the minimal network 
information for an implementation of a dynamic backup routing algorithm. When complete 
information is available, each node knows the sets A v and B v for each link in the network. 
For partial information, each node has only the values of F v , G y and R v available for each link 
in the network. 

Without knowledge of future demands for routing of active and backup paths, dynamic 
backup routing determines the active and backup path for the current NTP request that 
"optimizes" the use of network infrastructure based upon a specified criterion. One criterion is to 
minimize the sum of the bandwidths that is used by the active and the backup paths. When no 
restoration, and thus no backup path, is provisioned, this criterion leads to min-hop routing. 

First, weighting with link usage costs for dynamic backup routing for a single-link failure 
with i) partial and ii) complete information is described. If link /(/, j) is used in the active path, a 
backup path exists bypassing link IQJ) so as to backup any failure of this link. This backup path 
starts at (or upstream from) the node /, but may terminate at any downstream node between node 
j and the destination t on the active path. For simplicity, the backup path for link /(/, j) starts at 
node i and terminates at node j. The overall bandwidth when link /(/, j) is used in the active path 
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is the sum of the bandwidth for using it in the active path and the bandwidth used for backing up 
the link. The bandwidth required if link /(/, j) is used on the active path is defined as the demand 
d=b units. The bandwidth required to backup link l(i,f) may be then be used to determine the 
shortest path from node / to node j after removing link /(/, j). 

The usage costs for weighting each link depends on the network information model used. 
For complete information, the sets A & and B tJ are known for each link /(/, j). Backup paths may 
be shared between those demands (existing provisioned NTPs) whose active paths do not share 
common links. The quantity 0™ is defined for each link pair l(i t j) and l(u, v). This quantity 0™ 
is the usage cost of using link l(u, v) on the backup path if link /(/, j) is used in the active path. 
To compute the value of 0™ , the set $fj v = A y fl B uv (where "n" is the mathematical intersection 

of sets) is defined as the set of demands that use link /(/, j) on the active path and link l(u, v) on 
the backup path. The sum of all the demands may be represented by the variable Sjj v as defined 

in equation (3): 



^=1 



(3) 



If the current demand is for b units of bandwidth between nodes s and f, then 0™ is 
defined as in equation (4): 

fO ifS^ + b<G uv 

and(i,j) ^ (w,v) 
8™+b-G w if5™+b>G w and 
Kv > S ^ + b-G uv 
and(ij)±(u,v) 
oo Otherwise 

If only partial information is available, then the relation of equation (5) holds: 

s;; v <f ij v(/,y) v(«,v). (5) 



07 = 



(4) 
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Given the relationship of equation (5), then the cost 0™ of a link l(u, v) with partial information 
is given as in equation (6): 

0 ifF u +b< G uv and 

F Q +b-G w ijF !J +b>G uv andR uv > (6) 

F }J +b-G uv and(iJ)*(u,v) 
oo Otherwise 

For the partial information scenario, since the precise value for 5™ is not available to the routing 
5 algorithm, the value for F v is employed as an approximation for the value of 5™ . 

S Since links and /(w,v) are not both in the active and the backup paths, the value of 

*3 0™ is set to infinity if /(/, j) = l{u, v). This ensures that the active and backup paths will be 

y disjoint. The quantity 0™ represents the amount of backup capacity (i.e., available capacity 

m reserved for back-up paths) on link l(u, v) that is already reserved for backup paths of previously 
CEO routed demands that use link /(/, j), and, hence, the amount that cannot be used to backup the 
r i current demand if it, too, were to use link j) in the active path. If Sf/ + b < G uv then the 

r =J current demands may be backed up on link /(«, v) without reserving any additional bandwidth. 

The cost of using link /(/, j) may then be calculated as the sum of the cost of using link /(/, 
j) on the active path and the cost of its bypass path. To determine the cost of bypassing link /(/, 
1 5 j% the shortest path from node i to node j is computed via a shortest-path routing algorithm 

(excluding link /(/,/)) where the cost of each link l(u, v) in the path is given by 6™ . The length 

(also termed distance) of this shortest path between node i and node j is defined as 0 V . The 
"usage" cost of using a link /(/, j) on the active path is the sum of the bandwidth usage on the link 
j) and bandwidth usage for the bypass of the link /(/, j) (i.e., b + 0 V ). Once usage costs are 
20 associated with each link in the network (using a total of m shortest-path computations), the 

shortest path is calculated between source node s and destination node t using b + <t> l3 as the cost 
of link /(/, j). Thus, the cost of a backup path may be determined by a series of shortest path 
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problem computations: one computation for each link in the network (for up to m links), and one 
for the network once the usage costs are assigned to the links* Therefore m + 1 shortest path 
problem calculations are performed. This cost of a backup path gives the minimum amount of 
bandwidth without intra-demand sharing taken into account 

To account for the backup path for link /(/, j) starting at node / but ending at any node on 
the path from j to / (including 7 and t\ the above-described method of link usage cost and backup 
path cost calculation is modified as follows. The shortest path (e.g., Dijkstra's) algorithm is 
executed backwards starting at the destination node (termed the "sink" of the graph) for each 
node between destination node t and node 7. Thus, preferred embodiments of dynamic backup 
routing reverse the direction of the network links and each of the series of shortest-path 
computations is executed by finding the shortest path backwards from the destination node t to 
the source node s. 

FIG. 6 shows a network illustrating the shortest-path computations backward from the 
destination node t for one step in the algorithm. The dark lines in the graph represent the shortest 
path tree when Dijkstra's algorithm is executed backwards from destination node t. For every 
node that is permanently labeled in (i.e., a confirmed element of) the shortest path tree there is a 
unique path from that node to the sink. For example, as shown in FIG. 6, node k is permanently 
labeled when we are constructing the shortest path tree from the sink ("sink" being the graph 
term for the end node, in this case the destination node /) to the node L 

Associated with node k is the path P(k) defined by links l(k,l), l(lm), and l{mj) (i.e., in 
graph notation P(k) = {l,m, t}) along the shortest path tree from node k to the destination node /. 
For link l(k, 7) in the network, the cost of using link l(kj) in the active path is the sum of 
bandwidth currently being routed over link l(k, j) and the cost of backing up link l(k, 7). The 
dotted lines in FIG. 6 illustrate three different paths 601, 602, and 603 to backup link (£,7) that 
may be employed for a portion of the active path to the destination node /. The shortest path 
from k to any node in P(k) is computed by running Dijkstra's algorithm from 7 using 0^ on link 

(w, v), and terminating the algorithm when the node in the set P(k) is permanently labeled by the 
algorithm. 

Dynamic backup routing for a single-link failure and accounting for intra-demand sharing 
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of backup bandwidth is now described. To account for intra-demand sharing, the dynamic 
backup routing algorithm maintains a vector at each node that tracks reserved bandwidth that is 
used by other, previously routed demands. Specifically, the vector provides for tracking the 
amount of bandwidth reserved for the current demand that may be used for backing up all links 
from the given node to the destination, Intra-demand sharing of bandwidth occurs when the link 
/(/, j) uses link l(u, v) for a backup and reserves a bandwidth of w units on link /(w, v). When 
some other link l(k, I) on the active path wants to use link l(u y v) for its backup path, then, in 
addition to any inter-demand sharing, this other link may use the already reserved bandwidth of 
w units on link l{u f v) for "free" (no added usage cost to the link). 

To keep track of the amount of reserved bandwidth at each link, the vector X u is defined 
for each node u. The vector X u has a length m equivalent to the number m of links in the graph of 
the network. The value of element X u u for link in vector X u represents the amount of 
bandwidth reserved by the current demand for all the backup paths for all the links leading from 
node u to the destination L This bandwidth reservation for the current demand can be used to 
save bandwidth by intra-demand sharing, when backing up the links from u to the source s that 
are yet to be determined by the implementation of the dynamic backup routing algorithm. 

For example, for the network of FIG. 6, when the backup path for link J(k, j) is being 
determined, the shortest path is determined in the backward direction from node; to node t The 
m-length vector X J represents the reservation made for this demand for all of the backup paths 
from node j to the sink. This path is known since there is at least one unique path from node/ to 
the sink in the shortest path tree. For a given link /(m, n) in the network, the variable k mn is 
defined as given in equation (7): 

Kn-F kj +b-B nm -X } mn . (7) 

w here d=b is the bandwidth of the current demand. Then the incremental usage cost l mn of link 
l(m, n) when determining the shortest backup path (similar to equation (4)) is given in equation 
(8): 
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$ mn if° ^k mn <b and R mn > k mn and 

i 

(tn,n)*(kj) (8) 
oo mn Otherwise 



Maintaining the vector at each node and modifying the incremental usage cost as given in 
equation (8) allows for a method for accounting for the intra-demand sharing within the dynamic 
backup routing algorithm. 

The previously described techniques for dynamic backup routing with single-link failure 
may be modified to account for single-element failure by generating node bypass paths. Two 
distinct modifications are made. One modification avoids those links that are incident on the 
failed node, and the other modification accounts for all the links incident on the node failing 
simultaneously 

First, when the cost of including link in the active path is determined, the cost of a 
backup from node / to the successor of node j does not include using any of the links incident on 
node j. When the dynamic backup routing algorithm advances backwards from the sink, the 
successors of all the nodes permanently labeled by Dijkstra's algorithm are already known since a 
path has been established from that node to the destination. 

Second, when a node fails, all links incident on the node fail, and the cost of the backup 
accounts for all the links incident on the node failing simultaneously. The dynamic backup 
routing algorithm accounts for routing of demands on those links that are outgoing links from the 
node to their backup paths. For example, when computing the cost of using link /(z, j) in the 
active path, the cost of backing up demands that use link /(/,/) for / € V is accounted for. These 
two modifications to equations (4) and (6) provide the usage cost expressions of using link l(u, v) 
as given in equation (9) for complete information and equation (10) for partial information: 
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0 ifY 8f k +b< 

G„and(iJ)*(u,v) 

+ b- G uv and 
oo Otherwise 



9™ 



0 ^^ +h ^ G " 

and(i,j)^(u,v) 



and^F tl +b-G w (10) 



and(Uj)*{u,v) 
oo Otherwise 



The algorithm for dynamic backup routing with a single-link failure using partial 
information is now illustrated with the pseudo-code below. One skilled in the art may readily 

5 modify the algorithm for other cases. Dynamic backup routing in accordance with the present 
invention may be implemented with three routines, described subsequently, and the following 
notation is used herein for the three routines. The variables T and V each represent a set of 
temporarily labeled nodes of graph GR(V,E), and the variables P and P' each represent a set of 
permanently labeled nodes of graph GR(V,E). Node labels employed during each execution of 

10 Dijkstra r s algorithm are represented by variables $ and y. Vectors Q and Q' each represent a 
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predecessor array of nodes along the shortest path tree for computations at a current node. 

A given node u in graph GR(V,E) has an associated arc-length array X w , where of X w 

represents that amount of bandwidth reserved on link for the current demand d on all links 
on the path from node u to the destination node t. Each invocation of Dijkstra's algorithm begins 
from the destination node t. Therefore, at any given point in the algorithm and for any 
permanently labeled node w, there is a unique path from u to the destination t and hence X u is 
known for any permanently labeled node. An arc-length array ft is defined to temporarily store 
the value of y for node u (represented as y M ). 

In accordance with a first embodiment of the present invention, pseudo-code for dynamic 
backup routing with complete information for single-element failure is now described. In order 
to share the available backup path bandwidth in the network, every node knows how each 
demand in the network is routed. This situation may arise if routing is accomplished by a 
centralized route server. The main routine is LOCAL_EDGE_DISJOINT( ) which generates and 
initializes the network graph GR(V,E). The main routine iteratively steps through the links of the 
graph GR(V,E) to weight the links, with each link weight based on a cost of providing the backup 
path. The main routine during each iteration calls the subroutine ALTJPATH_COST( ) that 
determines the cost of providing the link with a local backup. The routine ALT_PATH_COST( ) 
computes the sum of the usage costs for each link by summing the number of links for each 
partial backup path that routes the demand. The sum is thus computed iteratively by invocation 
of the subroutine SHORT_PRED_PATH( ). Once weighting of links by the main routine 
LOCAL_EDGE_DISJOINT( ) is accomplished, the main routine then determines the shortest 
path through the network for the active path based on the link weights. Both the routines 
LOCAL_EDGEJDISJOINT( ) and SHORT_PRED JPATH( ) as given below may be considered 
as modified versions of Dijkstra's algorithm. 



LOCAL_EDGE_DISJOINT(5 J t) 



100 



^INITIALIZATION/* 



101 



Reverse all arcs in the network. 



102 T= V; P = 0;<pt = O; <pj 



= oo\fj ^ / 
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103 Ai„ = 0 Vl(m,n)eE, Q{t) = </> 

104 ^ITERATIVE STEP/* 

1 05 k = Arg min jeT (<|>j)- 

106 If k = j GO TO Step 117. 
5 107 T= T\{k} and P = P u {k}. 

108 For each j e T, l(k, j) e E 

1 09 w kj = ALTPATHCOST (k, j) 

110 if($ >w kj + <p k ) 

111 <f>j = (l>k +Wkj 

j) 112 Q0)=k 

2 113 Go to Step 105 

0 114 */TERMINATION/* 

E 117 Exit. 

\['5 ALT PATH _COST(A, j) 

J 200 ^INITIALIZATION/* 

201 u = Q(k) andifu = 0thenu = k. SetMIN= w . 

202 ITERATIVE STEP/* 

203 If « = 0gotoStep21O. 

20 204 a = SHORTPREDPATH (k, u,j). 

205 if(a<MIN) 

206 MPN = a 

207 X> mn =fi m y(m,n)eE 
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208 u = Q(u) Go to Step 203. 

209 * /TERMINATION/* 



210 



304 



Exit. 



SHORT_PRED_PATH(£, u, j) 

5 300 */INITIALIZATION/* 

301 If A *t then <fr™ = A k] n B mn and 8 mn = £ ^ d v V(m») e E. 

302 If k = t then <j>™ = A kj n B mn and £ Z ^ ^ V(w») e £. 

303 If A; then 



0 < 0 

^ i/O < 5 mn < d,R nm > 5 mn ,{m,n) * (kj) V(*,/) e E 
oo Otherwise 



W 305 If* = f then 



15 



306 

307 
308 



0 ifS mn < 0 
oo Otherwise 



T' = V, P'= ft y u = 0, % = oo Vj*u 
Ai„ = 0 V(m,n)€E 



309 ITERATIVE STEPS/* 

310 w = Arg min 1 eT('w ; y)- If w = s go to Step 321. 

311 r=F\{w}andP , = P / u{w}. 

312 For each / e 7", (5, i) e E 

313 if (y f + 

314 y,=yw + ls, 
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315 Q\i) = w 

316 Go to Step 310. 

317 ^/TERMINATIONS 

318 Set fi m = X u m V(ot,»)6£ 

319 if arc (mn) is on the shortest path from u to j: 

320 Set/U = ^ B + /™ 

321 Exit 

Pseudo-code for single-element failure with partial information is now given for the 
second exemplary embodiment. While it would be advantageous for every node to know how 
each demand in the network is routed, such as if routing is done via a centralized route server, 
most networks have decentralized routing. However, if a link-state flooding mechanism exists in 
the network, dynamic backup routing may be implemented. The link-state flooding mechanism 
propagates information throughout the network including, for each link, the total amount of 
bandwidth on that link that is used by primary paths, the total amount of bandwidth that is used 
by secondary path and the residual capacity on that link. This partial information is used by the 
source node of the NTP request defined by the triple {s, t, d} to route the demand d=b units of 
bandwidth. The main routines are again named LOCAL EDGE DIS JOINT( ), 
ALT_PATH_COST( ), and SHORT_PRED_PATH( ) with cost calculations modified for partial 
information as given in equation (6). 

LOCAL EDGE DISJOINT (5, f) 

1 00 ^INITIALIZATION/* 

1 0 1 Reverse all arcs in the network GR( V, E). 

102 r = F;P = 0; 0,=O; ^=qo Vy*/; 

103 4*„=0 \/(rn,n)GE; 0(0 = 0. 

1 04 * /ITERATIVE STEP/* 

105 k = Argmin,eT0/. 
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106 If it = 5 go to Step 115. 

107 T=T\{k} andP = PU {k}. 

108 For each j £ T , (kj) 6 E . 

1 09 w kj = ALT_P ATH_COST(A, j) 

5 110 if Ob' >Wkj+<t>k) 

111 <fa = <t>k + Wkj 

112 Q(/) = k 

113 Go to Step 105. 

114 ^/TERMINATION/* 
P 115 Exit. 



I* ALT PATH COST(k.j) 

m 200 ^INITIALIZATION/* 

O 201 u = Q(k) and, ifw = 0, thenw = &. SetMIN = a>. 

ft 202 */ITERATIVE STEP/* 

ri 203 lfu = 0, then go to Step 210. 



204 a = SHORT_PRED_PATH (k, u,j). 

205 If(a<MIN) 

206 MIN = a 

20 207 X J m =P m y{m t n)sE 

208 w = <2O)GotoStep203. 

209 */TERMINATION/* 

210 Exit. 
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SHORTPREDPATH (k, u, j) 

300 ^INITIALIZATION/* 

301 If * *t, then 8 mn =F kj +d- G mn - A u m V(m«) e E. ; otherwise 

302 If * = / then S mn = ^ kJ) mb F kl +d- G mn - l u mn V(mn) e E. 

'0 ifS nm < 0 

5 303 lfk*tthenl mn =ls mn ifO<S mn <d,R mn >S nm ,(m,n)*(k,l)V(kJ)eE 

oo Otherwise 



304 If A: = /then/ 



0 ifS mn < 0 

S mn (f0 ^ 5 mn^ d and Kn * 8 mn and ( m > ») * (*» j) 

oo Otherwise 



% 305 


T'=V;P'=frru = 0;rj=«> 




1 306 


<„ = 0, V(m,n)eE 




1 307 


*/ITERATIVE STEP/* 




IP 308 


w = Arg min,erW/- 




^ 309 


Ifw = 5 go to Step 319. 




1 310 


7"=7"\{w} andP'=P'u{w}. 


311 


For each i e 7/', (s. /) e E 




312 


if (y, > /„ + y w ) 




15 313 


7, = Jw + hi 




314 


0'(i) = w 




315 


Go to Step 308. 




316 


*/TERMINATION/* 




317 


Set J3 mn = XI, V(m,n)eE 
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318 if arc (mri) is on the shortest path from u to y , set p mn = X u nm + l mn . 

319 Exit 

Pseudo-code for implementations of dynamic backup routing for single-element failure 
with no information may be derived from the methods described for partial information and 
5 using the cost calculations as described previously for this case. Similarly, pseudo-code for 
implementations of dynamic backup routing for single-link failure with complete, partial or 
minimal information may be derived from the methods described for complete information or 
partial information with single-element failure. Specifically, the algorithms are modified to 
remove only the failed link rather than the failed node and all incident links on the failed node in 
10 the directed graph GR(V,E). Thus, these scenarios may be considered as simplified cases of the 
described embodiments. 

^3 As would be apparent to one skilled in the art, the various functions of dynamic backup 

iri routing for local restoration may be implemented with circuit elements or may also be 
'fi implemented in the digital domain as processing steps in a software program. Such software may 
55 be employed in, for example, a digital signal processor, micro-controller, or general-purpose 
s computer. 

- J The present invention can be embodied in the form of methods and apparatuses for 

rS practicing those methods. The present invention can also be embodied in the form of program 
H code embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other 
20 machine-readable storage medium, wherein, when the program code is loaded into and executed 
by a machine, such as a computer, the machine becomes an apparatus for practicing the 
invention. The present invention can also be embodied in the form of program code, for 
example, whether stored in a storage medium, loaded into and/or executed by a machine, or 
transmitted over some transmission medium, such as over electrical wiring or cabling, through 
25 fiber optics, or via electromagnetic radiation, wherein, when the program code is loaded into and 
executed by a machine, such as a computer, the machine becomes an apparatus for practicing the 
invention. When implemented on a general-purpose processor, the program code segments 
combine with the processor to provide a unique device that operates analogously to specific logic 
circuits. 
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It will be further understood that various changes in the details, materials, and 
arrangements of the parts which have been described and illustrated in order to explain the nature 
of this invention may be made by those skilled in the art without departing from the principle and 
scope of the invention as expressed in the following claims. 
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